Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend posting-group-max-key-series-ratio for add all posting group #8083

Merged

Conversation

yeya24
Copy link
Contributor

@yeya24 yeya24 commented Jan 31, 2025

  • I added CHANGELOG entry for this change.
  • Change is not relevant to the end user.

Changes

We introduced posting-group-max-key-series-ratio in #7961 to mark a posting group as lazy if it fetches a lot of keys. But at that time, it was only applied for posting group with add keys for example =~".+" or !="".

The same problem of fetching a lot of postings and unable to be optimized can also occur for posting groups with remove keys. We had an issue with matcher pod=~"" which ended up becoming an add all posting group with removing all postings for pod label. This requires fetching a lot of keys and unable to be optimized. This PR should apply the same optimization and solve the issue here.

Verification

@yeya24 yeya24 marked this pull request as ready for review January 31, 2025 21:24
Copy link
Contributor

@alanprot alanprot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!! This makes sense to me!

Copy link
Member

@saswatamcode saswatamcode left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@yeya24 yeya24 merged commit 8cd83bf into thanos-io:main Feb 2, 2025
20 of 22 checks passed
@yeya24 yeya24 deleted the extend-max-key-series-ratio-remove-keys branch February 2, 2025 18:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants